Neural Responses to Speech-Specific Modulations Derived from a Spectro-Temporal Filter Bank

نویسندگان

  • Marina Frye
  • Cristiano Micheli
  • Inga M. Schepers
  • Gerwin Schalk
  • Jochem W. Rieger
  • Bernd T. Meyer
چکیده

This paper analyzes the application of methods developed in automatic speech recognition (ASR) to better understand neural activity measured with electrocorticography (ECoG) during the presentation of speech. ECoG data is collected from temporal cortex in two subjects listening to a matrix sentence test. We investigate the relation of ECoG signals and acoustic speech that has been processed with spectro-temporal filters, which have been shown to produce robust and reliable representations for speech applications. The organization of spectro-temporal filters into a filter bank allows for a straight-forward separation into spectral or temporal only, as well as true spectro-temporal components. We find electrodes positioned over the superior temporal gyrus that is associated with the auditory cortex to show significant specific high gamma activity to fine temporal and spectro-temporal patterns present in speech. This indicates that representations developed in machine listening are a suitable tool for the analysis of biosignals.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hooking up spectro-temporal filters with auditory-inspired representations for robust automatic speech recognition

Spectro-temporal filtering has been shown to result in features that can help to increase the robustness of automatic speech recognition (ASR) in the past. We replace the spectro-temporal representation used in previous work with spectrograms that incorporate knowledge about the signal processing of the human auditory system and which are derived from Power-Normalized Cepstral Coefficients (PNC...

متن کامل

Spectro-temporal directional derivative features for automatic speech recognition

We introduce a novel spectro-temporal representation of speech by applying directional derivative filters to the Melspectrogram, with the aim of improving the robustness of automatic speech recognition. Previous studies have shown that two-dimensional wavelet functions, when tuned to appropriate spectral scales and temporal rates, are able to accurately capture the acoustic modulations of speec...

متن کامل

Robust phoneme recognition based on biomimetic speech contours

It has been previously suggested that ensembles of central auditory neurons optimize a sustained firing criterion as part of the underlying neural code for representing sound. Moreover, computational studies have shown that optimizing such a criterion yields ensembles of spectro-temporal receptive fields akin to those observed in physiological studies. In this study, we show that these emergent...

متن کامل

Proceedings of Meetings on Acoustics

We developed a new noise-reduction algorithm based on a joint spectro-temporal representation of signals. The algorithm was inspired by the discovery in our laboratory of higher-level avian auditory cortical neurons that showed invariant responses to communication signals. The algorithm consists of an analysis step and a synthesis step. In the analysis step, the sound is first decomposed into n...

متن کامل

Spectro-temporal modulations for robust speech emotion recognition

Speech emotion recognition is mostly considered in clean speech. In this paper, joint spectro-temporal features (RS features) are extracted from an auditory model and are applied to detect the emotion status of noisy speech. The noisy speech is derived from the Berlin Emotional Speech database with added white and babble noises under various SNR levels. The clean train/noisy test scenario is in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016